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The purpose of this note is to give a classification of the orbital structure of certain reductive 
group actions on the Lagrangian Grassmanian. The groups under consideration are Sp x Sp 
and GL. In general, the finiteness of orbits is known ( [8], [1], [9], [2], [TO]). However, the 
homogeneous structure of each individual orbit is not known except perhaps the generic open 
orbit N. The main results are given in Theorem 12.21 and Theorem 13.21 Some of the results here 
will be used to analyze the representations of the universal covering of the symplectic group on 
the Shilov boundary. 

1 Definitions 

Let (V, O) be a symplectic space of dimension 2m. Let U be a subspace of V. Define 

U ± = {veV\ n(v,U) = 0}. 

Sometimes, we also write it as U ± '^. A subspace U of V is called isotropic if and only if U 1 - 5 U. 
Equivalently, U is isotropic if Cl\u is zero. An isotropic subspace of V is called a Lagrangian 
subspace if dimU = dl ™ v . Obviously, d ™ y is the maximal dimension of an isotropic subspace. 
So U is Lagrangian if and only if U' L = U. 

Let Sp(V) be the symplectic group. Let Iso(V, i) be the set of i-dimensional isotropic sub- 
spaces of V. Then SpiV) acts on Iso(V,i) transitively. Fix a base point U G Iso(V,i). Let 
Pu be the stablizer of U. Then Pjj is a maximal parabolic subgroup and Iso(V, i) = Sp(V) /Pjj. 

Let C{V) be the set of Lagrangian subspaces of V. C(V) is called the Lagrangian Grass- 
manian. Let U be a base point in C(V). Then the stabilizer Pu is isomorphic to the Siegle 
parabolic subgroup and C{V) = Sp(V) / Pu ■ 

Unless stated otherwise, all vector spaces and groups are over R. 



Wee-Teck Gan just informed me that the stabilizer for Sp x Sp action was computed by Ikeda, see Lemma 
3.1 in 7 and the paragraph after it 
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2 Sp x Sp action on Lagrangian Grassmanian 

Let m, n be two positive integers and m < n. Let (Vi, fii) be a symplectic space of 2m dimen- 
sion and (V 2 ,£l 2 ) be a symplectic space of 2n dimension. Let V = V\ © V 2 and O = fix — Q 2 . 
Then (y, 0) is a symplectic space. Let Pi be the canonical projection from V to V\ and P 2 be 
the canonical projection from V to V2. In this section, we are interested in the orbital structure 
of Sp(V±) x Sp(V 2 ) on C(V\ © V2). The classification of Sp(V\) x Sp(V2)-orbits is well-known 
(see [3], [1], [8]). The isotropic group is obtained in Theorem 12.21 

Let U G C(V). Let U x = U n Fi and *7 2 = U n F 2 . Then 

• f/i is an isotropic subspace in (Vi,f2i). 

• [^2 is an isotropic subspace in (V^,^)- 

Lemma 2.1 Let U G £(V). T/ien P^U) 1 ^ 1 = U x and P 2 (U) L ^ 2 = U 2 . 

Proof: Suppose that x E V\ and fii(a?,Pi(17)) = 0. Then n(s,Pi(J7)) = 0. Clearly n(x, F 2 ) = 0. 
So V 2 + Pi (?/)) = 0. Notice that u - Pi (it) G V 2 for any u G U. Hence fi(x,E7) = 0. 
This implies that x G U. It follows that x G £7 H V\ = U\. The converse is also true, that 
is, VL\(U\, P\(U)) = 0. This follows directly from Q(Ui,U) = 0. We have thus shown that 
Pi(U) ±,Ql = U\. The second statement follows similarly. □ 

Corollary 2.1 The null space of VL\\p 1 (jj^ = U%. The null space o/ri 2 |p 2 (C/) = ^2- 

Corollary 2.2 fii^m) reduces to a nondegenerate form Q[ on P\{U) /U\. Q,2\p 2 (u) reduces to 
a nondegenerate form Q 2 on P 2 {U)/U 2 . Furthermore, 

Pi(£/)M = u/(u x © u 2 ) * p 2 (u)/u 2 . 

Proof: The first two statements are obvious. Since kerP\ = V 2 . Therefore, P\{U) — U/U nV 2 = 
U/U 2 . Our assertion follows immediately. □ 

Corollary 2.3 dim(C/ 2 ) = dim(f7i) + n — m. 

Proof: Since Ui = Pi(Ui) ± ^ 1 , dim U x + dim(Pi(E7i)) = 2m. Notice that 

dim(Pi(£/i)) = dim(77/£/ 2 ) = dim £7 - dim(y 2 nf/) = (n + m)- (dimC/ 2 ). 
Hence, dim C/i + n + m — dim f7 2 = 2m. Consequently, dim U\ = dim U 2 + m — n. □ 

Theorem 2.1 ( |3j, [8]) £ei Li be the set of Lagrangian subspaces of (V,£l) such that 

dim(£7n Vi) = i. 

Then dim(C/ D V 2 ) = i + (n — m) and Ci is a single Sp 2m (R) x Sp 2n (M) orbit. 
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Various form of this theorem can be found in a number of papers. Some come with a proof and 
some do not come with a proof. 

Theorem 2.2 Let i < m. Let P%^m-2i be a maximal parabolic subgroup of Sp2 m (M.) preserving 
an i-dimensional isotropic subspace. Let P n _ m+ j i2m _ 2 j be a maximal parabolic subgroup of 
£p 2n (R) preserving an n — m+ i-dimensional isotropic subspace. Let GLiSp2 m -2iNi,2m-2i be the 
Langlands decomposition of Pi, 2m — 2i- Let GL n _ m+ iSp2 m -2i(^-)Nn-m+i,2m,-2i be the Langlands 
decomposition of P n _ m +j i2m _ 2 i. Let 

Hi = {(m 1 uni,m2 t u~ 1 n 2 ) \ m 1 G GLi,m 2 G GL n ^ m+i ,u G 5p 2m _ 2i (R), n\ G iVj,2m-2i,n 2 G iV n _ m +j i2m _ 2 i}. 
Then Li = Sp2 m (^-) x Sp2 n (J&) / Hi- In particular, if m <n, then 

Co = Sp2n(R)/GL n—m —m,2m • 

Proof of Theorem 12.11 and Theorem 12. 2\ It suffices to prove that Li is a single S , p 2m (M) x 
5p 2n (R)-orbit. For every U G Li, let tt(U) = {U\, f7 2 )- Then dimC/i = i and dimC/ 2 = n — m + i. 
Clearly, ir is a map from Li to Lso(2m, i) x Lso(2n, i + n — m). We claim that ir is a projection. 
Let us fix U\, U 2 . Consider 

= e A I n Vi = C7i, c/ n v 2 = u 2 }. 

We will show that £[/i,t/ 2 is nonempty and isomorphic to Sp 2m _ 2 j(lR). 

Since Ui,U 2 are fixed, Pi(U) = U± ,Ql and P 2 (E7) = U^^ 1 are known. In addition 

C/ C Pi(C/) © P 2 (f7) = u^ Ql © c/ 2 ±,ni . 

Clearly, U G Lu x ,u 2 ls uniquely determined by U fU\ ©(72, a 2m — 2i dimensional subspace in 

U^' Ul (BU^ ni /(U 1 eU 2 ), 
and vice versa. Let u,w G U. We compute 

o = n( u ,w) = ni(p 1 (u),p 1 (w))-n 2 {p 2 {u),p 2 (w)) = fii([Pi(«)], [P!H])-o 2 ([p 2 (u)], [p 2 H]). 

Here [Pj(tt)], [Pj(u;)] G U^ ,Q * /Ui and 1^ is the reduced symplectic form on ' 4 For each 
C7 G A^tfc, define P/ : C//C/i © U 2 -> U^/Ui by letting P/([n]) = [P(u)]. We see that 
t7 G Lu lt U 2 if an d only if for every [it], [to] G i7/£/i © U 2 , 

s)' 1 (p 1 '(M),p1(H)) = o 2 (p^(M),p 2 'H)- 

Notice that P/ is injective. An easy computation shows that 

dim(U/Ui © U 2 ) = 2m-2i = dim^'" 1 /U L ) = dim^'" 2 ). 
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So P- is surjective. It follows that U G A/1,1/2 is in one-to-one correspondence with P^iP'x) , 
a symplectic isomorphism between {U^^ 1 /U\, O^) and (U 2 ' 2 /U2, fi 2 )- The correspondence is 
explicitly given by 

g s P {ut ai /UxtU^ /u 2 ) - {([«i],0([«i]) g t/^M © u^ n yu 2 } 

-» {(«i,«2) I uj G J7 1 ±,ni ,« 2 G U^ n \u 2 + U 2 = <f>(ui + C7i)}. 

(1) 

We have thus obtained a principal fibration 

Sp2m-2i0&) — ► A — > Iso(2m, i) x Iso(2n, n — m + i). (2) 

Observe that the stabilizer of f/i in Sp(Vi), Pf/u ac ts on {/i and C/j ' 1 . Pjj l is of the form 
Sp2m-2i(^)GLiNi i 2 m -2i- It acts on U x ' 1 /Ux by the Sp 2m -2i(^) factor. By the correspondence 
[H P\j 1 acts on Cu lt U2 transitively. It follows that Ci is a single Sp2m(B0 x Sp2n0&) orbit. This 
is Theorem 12.11 

Notice that Iso(2m,i) = £p 2 m(R) / '-Pi,2m-2i and Iso(2n,n - m + i) = Sp 2n 0&) / Pn-m+i,2m-2i- 
Theorem 12.21 follows from the principal fibration ([2]). □ 

The following corollaries are more or less obvious. 

Corollary 2.4 Let < i < m. U G Ci if and only if there exist U\ G Iso(2m,i), U2 G 
Iso(2n,n — m + i)and a symplectic isomorphism between (U 1 ' 1 /Ui,^) and (U2 ' /U2, ^2) 
suc/i i/iaf C/i = ?7 H Vi and U2 = U fl V2 and 

17 = {(«i,U2) G t^'" 1 e I 0(«i + ^1) = «2 + *7 2 }. 

Tfere zs i/te reduced symplectic form on Ui ±,Qi /Ui. 

Corollary 2.5 Let i < m < n. Then dim(£j) = ( n + m +i)("+ m ) _ ^2 _ n ^ _|_ m ^ There are total 
of m + 1 S'p2n(lR) x 5'P2m(K) orbits in C(V) and 

C i+ i C 

3 GL 7l -orbits 

Let Q be a symplectic form on a 2n dimensional real vector space V . Let £ be the Lagrangian 
Grassmannian. Fix two Lagrangian subspaces W\ and W2 such that 

wi e w 2 = V. 

Clearly, O identifies W2 with W*, the dual of W\. Let GL ra be the subgroup of Sp(V, U) 
preserving W\ and W2. Let g G G7 n . Then g acts on C7 G C by 

#£7 = {(3x1,5*^2) I ix u x 2 ) G C/}. 
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Now we want to study the GL n orbits on C 



Let ei, e 2 , ■ ■ ■ be a basic for W\. Let /i, / 2 , . . . , f n be a basis for W 2 such that f2(ej, /,) = 5\ 
where dj is the Kronecker symbol. Clearly, can be identified with e*. Define J € End(V) by 
setting 




Put [/1 = ?7 n Wi and C/ 2 = n W 2 . Let 



= {U € £ I dim(f7 n Wi) 



i,dim(E7 n W 2 ) = j}. 



We have 

Lemma 3.1 £0,0 consists ofn+1 GL n orbits: 

rO pi pn 

M),0) ■ ■ ■ > M),0> • • • > M),0i 

where C l 00 = GL n /0(i,n — i). 

Proof: For every U G £0,0, define <pu{x\) = x 2 if and only if (xi,X2) G J7. Since dim[/ = 
dim W\ = dim VF 2 = n and dim J7 n W\ = dim J7 n W 2 = 0, ^17 is a well-defined isomorphism 
from Wi to W2. Intuitively, {/ is the graph of 4>u- Let (xi, 0[/(xi)), (yi, </>{/(y 2 )) G t^- Then 



Therefore (xi, J<f>u(yi)) = (yi> J<t>u(xi)) for all xi,yi G Wi. It follows that (xi, J<j>u(yi)) 1S a 
Hermitian form on 

Let 5 G GL„. Then 

= {(5x1, g* (f>u{xi) I xi G Wi} = {(xi,g*<f) U g~ 1 x 1 ) \ x\ G W{\. 

So 9 ;7 = g*(\>u9~ X ■ The Hermitian form 

(x 1 ,J(t) gU (y 1 )) = {x 1 ,Jg*4> u g~ 1 y 1 ) = {x u g* J g' 1 yi) . 

Clearly, GL n acts on the non-degenerate Hermitian forms with n+ 1 orbits. Each orbit consists 
of Hermitian forms with a fixed signature. Let C' l be the set of U such that (xi, J<t>u{y{)) has 
signature (i,n — i). Then £q is a single GL n orbit and C l = GL n /0(i,n — i). □. 

The case (dim U\, dim U 2 ) 7^ (0,0) is considerably more difficult. One needs to carry out two 
symplectic reductions. However, the ending result is easy to state. 



=Q((x 1 ,<f) U (x 1 )), (yi,(f>u(yi)) = £l{xi,(f>u(yi)) + ^(4>u{xi),yi) 
=fi(xi, <j)u(yi)) - to{yi,<f>u(xi)) = (xi, J(f>u(yi)) - (yi, J<f>u{xi)). 



(3) 
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Theorem 3.1 Each Cij consists of n — i — j + 1 GL n -orbits. 

We shall now give a proof of this theorem and the structure of each orbit will be stated at the 
end of this discussion. 

Let U € Cifi. Let XJ\ = U fl W\. Then U\ is an isotropic subspace. Fix an U\ C W\ and 
let 

c UuQ = {u e£\unw 1 = u 1 ,unw 2 = o}. 

We have the fiberation 

£u u o -* A,o -> G(n,i), 

where G(n,i) is the i-th Grassmanian of W\. Notice that GL n acts on G(n,i). Let Pjj 1 be the 
stabilizer of U\ € G(n,i). The -P^ is isomorphic to the block- wise upper triangular matrices of 
size (n — It suffices to study the action of Pjj 1 on Cu±fi- 

Consider now U^, with respect to O. Let be the reduced symplectic form on U±/U\. 
Since UxCU,UC U^. We see that 

[U]^ = U ± /U 1 = U/Ui. 

So U/Ui is a Lagrangian subspace of /U\. Then £j/i,o can be identified with a subset of 
C{Ui /U\). Furthermore, Pjj 1 acts on £/i and U^. The GL(i) factor acts on XJ\ naturally. The 
nilradical N acts on by shifts along directions in U\. We thus obtain a GL n _i action on 
£>(U\ /U\). By choosing U\ to be the linear space spanned by e\, . . . , e^, the GL n _j action on 
£(Ui /Ui) can be identified with the standard GL n _j action on £(IR 2n ~ 2 *). 

Let W£ = W 2 n C/i 1 . Then (W^ = W 2 © Z7i and dim^) =n-i. Furthermore 

(W£ C/i) ± = (W2 © ?7i) n ^ = W 2 ' © E7i. 

We see that W2 © C/i is a Lagrangian subspace in U^/U\. Since W 2 nU = 0, W' % + £/i D U = U\. 
Since Wi C and Wi is Lagrangian, W\/U\ is a Lagrangian subspace of /U\. Furthermore, 

U^/Ux = (W^ + Ux)/U! Wx/Ux. 

Finally, notice that C//C/1 n (W' 2 + C7i)/I7i = [0] and U/U\ n Wi/E/i = [0]. We see that 

blip = £0,0(0;, (w£ + WiM). 

By Lemma 13.11 we obtain 

Lemma 3.2 Ci$ consists of n — i + 1 GL n orbits: 

r0 nn—i 
*-i,0> • • • J ^,0 - 

Let Pi be the maximal parabolic subgroup with Langlands decomposition GLiGL n _iNi^ n _i. Then 
4 = GL n /GLiO(j, n-i- j)iV 4 , n _ 4 . 
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If ij ^ 0, we are yet to apply another symplectic reduction. Fix a^, a j-dimensional subspace 
of W 2 . U 2 is isotropic automatically. Let A,t/ 2 be the set of Lagrangian subspaces satisfying 

UnW 2 = U 2 , dim(UnWi) = i. 

Then we have a fibration 

£>i,u 2 -> -> G(n,j). 
Let P[/ 2 be the stabilizer of ^2 in GL n . Then P[/ 2 is isomorphic to GLjGL n _jNj tn ^j . 

Again, we construct the reduced symplectic form O2 on U^~/U 2 . Let W[ = W\ n JJ-f- Then 
(W[) L = Wi U 2 and dim(Wi) =n-j. Notice that 

(W[ e = (Wi e c/ 2 ) n ^ = e £/ 2 - 

We see that (W{ + U 2 )/U 2 is a Lagrangian subspace of U2 /U 2 . W 2 /U 2 is also a Lagrangian 
subspace of U 2 /U 2 ■ In addition 

ui/u 2 = (w[ + U2/U2) e w 2 /?7 2 . 

The group Pjj 2 acts on U2 /U 2 via the factor GL n _j. 

Since J7 is Lagrangian, U/U 2 is a Lagrangian subspace in jU 2 . Furthermore dim(C//?7 2 D 
Wa/Z7 2 ) = 0. Observe that 

u/u 2 n (w[ + c/2/^2) = c/ n (w{ + c/ 2 )/c/ 2 = (u n wi) + f/ 2 /c/ 2 

and 

(u n w^ = u 1 - + (wi) 1 = u + Wi + u 2 = u + w x = (u n wi)- 1 . 

So UnW{ = UnW 1 = U 1 . It follows that 

u/u 2 n (w( + c/ 2 /c/ 2 ) = (u n w x ) + t^M = c/i + tyf7 2 . 

Consequently, dim(f//C/ 2 n W[ + U 2 /U 2 ) = i. Now we can identify A,t/ 2 with 

c ifi {u^iu 2 , W 2 /U 2 ®W[ + U 2 /U 2 ) 

by 

?7 <-> C//C/ 2 . 

By Lemma 13.21 GL n _j acts on £^0(^2/^2) with n — j — z + 1-orbits: 

Cl (Ui-/U 2 ),...,£* it0 (Ui-/U 2 ) 

and 

4,0(^/^2) = GL n ^/GLiO(k, n-i-j- k)N n ^ j:l . 
To summarize, we have the following theorem 
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Theorem 3.2 Each Cij consists ofn — i— j + 1 GL n -orbits 

pO r-n-i-j 
^hV " " " i,3 

Let Pij t n-i-j be the block-wise upper triangular matrices with size (i,j,n — i — j). Let N be the 
nilradical. Then 

tffj = GL n /GLjGLiO(k, n-i-j - k)N. 
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